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Many thanks to all of the discussants for their ob- 
servations and suggestions and encouraging words. 
My response is quite short because I agree with all 
of their comments. 

Professor Evans points out the importance and 
potential difficulty of selecting which set of issues 
or adverse event definitions to include in the anal- 
ysis. They need to be approximately exchangeable 
in terms of prior belief as to their expected asso- 
ciations with Treatment and with covariates. Prior 
belief refers to your expert opinion before looking 
at the data to be analyzed — it would not be appro- 
priate to just select issues that are observed to have 
high odds ratios with treatment, for example, which 
might tend to bias the estimation of variance compo- 
nents in the model, making them appear too small. 
His suggestion of selecting SMQs that are formed 
from terms in a local region of the MedDRA hierar- 
chy seems reasonable, or of using other knowledge or 
data that seem to point to plausible exchangeabil- 
ity. I also agree with Professor Evans on the need for 
more experience with how MBLR works with vary- 
ing numbers of issues (K) and numbers of covariates 
(J) and varying sample sizes. My intuition is that 
the model should be robust to a wide range of K 
and sample sizes, but that it is probably not a good 
idea to allow J to be too large, on the rationale that 
collinearity often leads to problems in any regression 
model having many covariates. Perhaps J should be 
kept in the range of 1 to 5, and I suspect that it 
would be a mistake, leading to spurious results, to 
think of MBLR as a data mining technique, where 
you search for the best 5 covariates out of 50 avail- 
able, for example. Better to just use a few prespeci- 
fied covariates that have some prior justification for 
potential effects or interactions with treatment. 
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Professor Berry provides a nice overview of the 
inferential and medical difficulties raised by drug 
safety issues. Many of these difficulties are beyond 
the reach of any mere statistical model, of course. 
But in as much as consideration of multiplicities due 
to analyses of related medical events and to sub- 
group analyses contribute to these problems, per- 
haps the MBLR model, or similar approaches using 
Bayesian shrinkage, can help researchers see the for- 
est through the trees. 

Special thanks go to Brad McEvoy and Ram Ti- 
wari for their collaborations and discussions during 
the later development of MBLR, and now for their 
acute comments here. First, they provide an insight- 
ful and enlightening discussion of the relationship of 
the MBLR model to meta-analysis modeling in gen- 
eral, assuming that the data at hand come from mul- 
tiple studies. My choice, made for simplicity, was to 
treat the Study ID as just another categorical vari- 
able like patient age or sex. This should eliminate 
certain biases like those due to Simpson's paradox, 
and does allow the treatment effect to vary by Study, 
but does not treat Study as an independent random 
effect that could potentially interact with all other 
covariates. It also makes it difficult to build into the 
analysis the fact that patients were independently 
randomized within each study, which does not play 
much of a role in a Bayesian model, but is an im- 
portant aspect of the classical paradigm. McEvoy 
and Tiwari define an extended meta-analytic MBLR 
model that allows for Study (trial) to be a higher 
level of a hierarchical model and fit it to the data 
in the paper using the Markov chain Monte Carlo 
(MCMC) approach. That model is much more com- 
plex, since instead of just 4 prior standard deviations 
to estimate, there are (2K + 4) = 24 such hyperpa- 
rameters, which would make it impossible to fit us- 
ing the simpler methodology of the present paper. 
Much more research would be needed to assess the 
relative validity and reliability of this more compli- 
cated methodology. An alternative approach might 
be to fit the current MBLR model separately to the 
data from each study, and then using a more tradi- 
tional meta-analysis approach as a post-processing 
step applied to the coefficients and standard errors 
so obtained. 
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Drs. McEvoy and Tiwari also focus on the deci- 
sion to borrow strength across different issues (AEs), 
in that if your prior belief that the issues are ex- 
changeable is incorrect, then the shrinkage may not 
help and could possibly lead to extraneous variabil- 
ity. They point out that careful interpretation is es- 
pecially needed when a rare but severe issue is an- 
alyzed in conjunction with other more frequent but 
less important or interesting issues. This is always 
a potential problem whenever a more available vari- 
able is being treated possible marker for a less 
available but more medically severe event or process. 



Finally, these discussants used the MCMC method 
to re-estimate the MBLR coefficient estimates from 
the example data and show that they are remark- 
ably similar to those based on my Laplace approxi- 
mation method. We have replicated this result using 
in-house computations, using the same and similar 
models. 

Once again, many thanks are due to all of the 
discussants for their interesting and insightful and 
generous comments. 



